https://huggingface.co/spaces/nanotron/ultrascale-playbookHugging Face 发布了 Scaling LLM Training on GPU 的 playbook，应该会比 DeepMind 那本侧重 TPU 的 scaling book 更普适一些。 #llm

Parallel Experiments

https://jax-ml.github.io/scaling-book/ 非常值得学习的分享，作者列表里好几个 Gemini 核心团队的人😃 Sholto、Jacob、Sharad 等人都是超一流的 research engineer 🙏 #llm

https://huggingface.co/spaces/nanotron/ultrascale-playbook
Hugging Face 发布了 Scaling LLM Training on GPU 的 playbook，应该会比 DeepMind 那本侧重 TPU 的 scaling book 更普适一些。 #llm

huggingface.co

The Ultra-Scale Playbook - a Hugging Face Space by nanotron

This blog post explains how to efficiently train large language models (LLMs) using GPU clusters, providing insights and guidance on optimizing performance and resource utilization.

www.tg-me.com/it/Parallel Experiments/com.LinghaoCh/922

1.2K viewsLinghao Zhang, Feb 19 at 20:32

tg-me.com/LinghaoCh/922

Create: 2025-02-19
Last Update: 2025-06-13 10:35:40

BY Parallel Experiments

Share with your friend now:
tg-me.com/LinghaoCh/922

Parallel Experiments Telegram | DID YOU KNOW?

For some time, Mr. Durov and a few dozen staffers had no fixed headquarters, but rather traveled the world, setting up shop in one city after another, he told the Journal in 2016. The company now has its operational base in Dubai, though it says it doesn’t keep servers there.Mr. Durov maintains a yearslong friendship from his VK days with actor and tech investor Jared Leto, with whom he shares an ascetic lifestyle that eschews meat and alcohol.

If riding a bucking bronco is your idea of fun, you’re going to love what the stock market has in store. Consider this past week’s ride a preview.The week’s action didn’t look like much, if you didn’t know better. The Dow Jones Industrial Average rose 213.12 points or 0.6%, while the S&P 500 advanced 0.5%, and the Nasdaq Composite ended little changed.